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SANTRAUKA 

Straipsnyje pagrindziama kolegijp isorinio 
jvertinimo struktura aukstojo neuniversi- 
tetinio mokslo sektoriuje, atskleidziamos 
sio proceso metu kylancios problemos ir jg 
sprendimo galimybes: aptariamas kolegijg 
isorinio jvertinimo reiskinys ir pateikiama jo 
samprata; analizuojamas Europos aukstgjg 
mokyklp isorinio jvertinimo procesas ir api- 
budinami j j sudarantys etapai; taip pat prista- 
tomos Lietuvos kolegijp isorinio jvertinimo 
metu kylancios problemos ir jp sprendimo 
galimybes jvertinime dalyvaujancip asmenp 
poziuriu. 

PAGRINDINig SAVOKg APIBREZIMAI 

• Isoriniai jvertintojai - asmenys, nepriklau- 
santys kolegijos bendruomenei, kurie, inter- 
pretuodami surinkt^ susistemint^ ir isana- 
lizuot^ informacij^ siulo nutarim^ apie tos 
institucijos veiklos kokybes bukl^. Lietuvoje 
kolegijp isoriniai jvertintojai taip pat atlieka 
vertintojp funkcijas. 

• Ivertinimas - nutarimo priemimas, atlie- 
kamas remiantis vertinimo rezultatais, 
apie institucijoje sudarytg studijp s^lygp 
tinkamum^. 


ABSTRACT 

The article grounds the structure of the ex- 
ternal evaluation of colleges at the level of the 
non- university higher education sector, and 
it reveals the problems met in this process as 
well as possibilities for their solution: the phe- 
nomenon of the external evaluation of colleges 
is discussed and its concept is presented; the 
external evaluation process of the European 
higher schools is analysed and its stages are 
described; the problems and possibilities for 
their solution in the external evaluation of 
Lithuanian colleges are presented in the views 
of those participating in the evaluation. 

DEFINITIONS OF KEYWORDS 

• External evaluators - individuals outside 
the colleges community who interpret the 
data gathered, systematised and analysed, 
and propose the judgement on the quality of 
the institution’s work. In Lithuania, external 
evaluators of colleges also perform functions 
of assessors. 

• Evaluation - judgement, based on the results 
of the assessment, regarding the study oppor- 
tunities provided in the institution. 

• Evaluation structure - stages composing the 
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• fvertinimo struktura - jvertinimo proce- 
ss sudarantys etapai ir juos apibudinantys 
parametral. 

• Kolegijos isorinis jvertinimas - kolegijos 
bendruomenei nepriklausanciq asmenq atlie- 
kamas vertinimas ir, remiantis jo rezultatais, 
nutarimo priemimas apie institudjoje sudary- 
tij studijq s^lygLj tinkamum^ parengti specia- 
listus, orientuotus j praktin^ mokslo ir techno- 
logijp naujovemis pagrjst^ profesin^ veikl^. 

• Vertinimas - informadjos rinkimas, siste- 
minimas ir analize, siekiant priimti nutarim^ 
apie kolegijos veiklos kokybes bukl^. 

• Vertintojas - asmuo, renkantis, sisteminan- 
tis ir analizuoj antis informadj^ apie kolegijos 
veiklos kokyb^. 

jVADAS 

Europos aukstojo mokslo sektoriuje vis dau- 
giau demesio skiriama isorinio kokybes uzti- 
krinimo proceduroms ir kriterijams {London 
Communique, 2007; Mapping external quali- 
ty assurance in Central and Eastern Europe, 
2006). Akcentuojama, kad isorinis aukstp- 
jq mokyklij jvertinimas turi buti skaidrus ir 
atliekamas pagal apibreztus reikalavimus. 
fgyvendinant siuos tikslus butina aiskiai api- 
budinti isorinio jvertinimo process ir numa- 
tyti jo tobulinimo priemones. 

Lietuvos mokslininkai ir praktikai yra 
diskutav^ (Dienys, Pukelis, Ziliukas, 2005; 
Stumbrys, 2004 ir kt.) apie kolegiji^ isorinj 
jvertinim^, taciau truksta moksliniq tyrimp, 
pagrindziancip sio proceso nuoseklum^ ir 
nurodancip jo tobulinimo galimybes. Siame 
straipsnyje siekiama atsakyti j probleminius 
klausimus: kokias proceduras ir kokius etapus 
turi apimti kolegijp isorinis jvertinimas, ko- 
kios kliutys kyla sias proceduras taikant, kaip 
tas proceduras patobulinti, kad jvertinimo 
procesas butp kokybiskas, o jvertinimo metu 
gauti rezultatai veiksmingesni? Atsakymai 


evaluation process and parameters describing 
them. 

• External evaluation of colleges - assessment 
by individuals outside the college s community 
and, following the results of this assessment, 
their judgement on the study opportunities 
provided in the institution to prepare profes- 
sionals for practical work applying science and 
technological innovations. 

• Assessment - data gathering, systematisa- 
tion and analysis, with the intention to make a 
judgement on the quality of the colleges work. 

• Assessor - an individual gathering, system- 
atising and analysing data on the quality of the 
college’s work. 

INTRODUCTION 

In the European higher education sector, the 
attention for the procedures and criteria of 
external quality assurance is recently increas- 
ing {London Communique, 2007; Mapping 
external quality assurance in Central and East- 
ern Europe, 2006). It is emphasised that the 
external evaluation of higher schools should 
be transparent and carried out following the 
stated requirements. Seeking to attain those 
goals, it is essential to explicitly describe the 
external evaluation process and identify ways 
for its development. 

Lithuanian scientists and practicians (Die- 
nys, Pukelis, Zdiukas, 2005; Stumbrys, 2004, 
etc.) have discussed the external evaluation of 
colleges, however there is a lack of scientific 
research grounding the sequence of this pro- 
cess and directing to possibilities of its devel- 
opment. This article covers several problem- 
atic questions. Which procedures and stages 
should structure the external evaluation of 
colleges? What difficulties do appear applying 
those procedures in practice? How to improve 
the procedures to make the evaluation process 
of good quality and reach more effective results 
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j siuos klausimus aktualus aukstojo mokslo 
tyrejams ir politikams, isorinio kokybes uzti- 
krinimo agenturoms bei jvertinamoms insti- 
tudjoms - kolegijoms. 

Straipsnio tikslas - pagrjsti kolegijp is- 
orinio jvertinimo stmktur^ aukstojo neu- 
niversitetinio mokslo sektoriuje, atskleisti 
sio proceso metu kylancias problemas ir jp 
sprendimo galimybes. Siekiant sio tikslo, 
straipsnyje analizuojamas kolegijp isorinio 
jvertinimo reiskinys ir pateikiama jo sam- 
prata. Po to atliekama Europos aukstpjp 
mokyklp isorinio jvertinimo procesp ana- 
lize, kurios rezultatai leidzia isskirti penkis 
jvertinimo etapus ir nustatyti juos apibudi- 
nancius parametrus. Remiantis atskleistais 
jvertinimo etapais, pateikiami empirinio 
tyrimo rezultatai, parodantys Lietuvos kole- 
gijp isorinio jvertinimo metu kylancias pro- 
blemas ir jp sprendimo galimybes jvertinime 
dalyvaujancip asmenp poziuriu. Straipsnyje 
aptariami 2007 m. atlikto individualaus diag- 
nostinio pusiau standartizuoto pokalbio re- 
zultatai, gauti apklausus isorinj jvertinim^ 
organizuojancius asmenis, isorinius jvertin- 
tojus ir jvertintp kolegijp atstovus (vadovus 
ir uz kokybes uztikrinim^ kolegijoje atsakin- 
gus asmenis). 

1 

KOLEGIjg ISORINIO jVERTINIMO 
SAM PRAIA 

Kolegijos - neuniversitetines aukstosios mo- 
kyklos, kuriose turi buti sudarytos studijp 
s^lygos, leidziancios parengti specialistus, 
orientuotus j praktin^, mokslo ir technologi- 
jp naujovemis pagrjst^ profesin^ veikl^. Sip 
splygp tinkamump galima issiaiskinti atlikus 
vertinimp ir jo rezultatais paremtp jvertini- 
mp. Jvairus autoriai, aptardami vertinimo 
ir jvertinimo procesus, vertinimui (angl. 
assessment) priskiria informacijos rinkimp, 
sisteminimp ir analiz^, kurios duomenimis 


of evaluation? Answers to those questions are 
topical for higher education researchers and 
politicians, external quality assurance agencies 
and institutions being evaluated, i.e. colleges. 

The purpose of the article is to substanti- 
ate the structure of the external evaluation of 
colleges at the level of the non-university high- 
er education sector, and reveal the problems 
met in this process as well as possibilities for 
their solution. Following the purpose, the ar- 
ticle analyses the phenomenon of the external 
evaluation of colleges and presents its concept. 
Afterwards, the external evaluation process of 
the European higher schools is under analy- 
sis, and its results lead to the identification of 
five evaluation stages and parameters describ- 
ing them. Referring to the defined evaluation 
stages, the results of the empirical research are 
presented to reveal the problems and possibili- 
ties for their solution in the external evaluation 
of Lithuanian colleges in the views of those 
participating in the evaluation. The article dis- 
cusses the results of an individual diagnostic 
semi-standardised conversation, held in 2007, 
with the organisers of external evaluation, ex- 
ternal evaluators and representatives of the 
evaluated colleges (heads and ones responsible 
for quality assurance in the college). 

1 

CONCEPT OF EXTERNAL 
EVALUATION OF COLLEGES 

Colleges are non-university higher schools 
where study opportunities should be provided 
to develop professionals for practical work ap- 
plying science and technological innovations. 
The relevance of those opportunities might be 
identified by assessment and evaluation, when 
the latter is based on the assessment results. 
In the description of assessment and evalua- 
tion processes, various authors mention data 
gathering, systematisation and analysis as the 
constituents of assessment, whereas evaluation 
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naudojamasi priimant sprendim^ apie ti- 
riamo objekto kokyb^; o jvertinimu (angl. 
evaluation) laikomas pats sprendimo prie- 
mimas - nutarimas, kad tiriamas objektas 
yra geras arba blogas, atitinkantis arba nea- 
titinkantis suformuluotij tikslp, reikalavinuj 
ir vartotojq poreikii^ (Dienys, Pukelis, Ziliu- 
kas, 2005; Savickiene, 2005; Gurskiene, 2004; 
Kraujutaityte, 2003; Arendsas, 1998; Gage, 
Berliner, 1994 irkt.). 

Kolegijij jvertinimas gali buti vidinis ir 
isorinis. Vidinio jvertinimo metu aukstosios 
mokyklos bendruomene nustato kokybes bu- 
kl^ institucijoje ir priima sprendimus del pas- 
tarosios veiklos tobulinimo; isorinis jvertini- 
mas - nepriklausomij ekspertp nutarimas dd 
aukstosios mokyklos veiklos kokybes {Quali- 
ty Assurance and Accreditation: A Glossary of 
Basic Terms and Definitions, 2004). Vidinio 
jvertinimo rezultatai pateikiami jsivertinimo 
ataskaitoje (neformaliai ji dazniausiai vadina- 
ma savianalizes ataskaita arba tiesiog saviana- 
lize), kurioje parodomi pagrindiniai kolegijos 
privalumai ir trukumai pagal svarbiausius jos 
veikl^ lemiancius parametrus. Veliau gautq 
rezultatp pagrindu sudaromas ir jgyvendi- 
namas veiksmp tobulinimo planas. Isorinio 
jvertinimo metu kolegijos bendruomenei ne- 
priklausantys asmenys analizuoja jos pateik- 
t^ jsivertinimo ataskait^, lankosi kolegijoje, 
jvertina jos veiklos kokyb^ ir pateikia koky- 
bes gerinimo rekomendadjas. „Savianalize 
yra ne tiktai pirmoji isorinio vertinimo dalis, 
bet ir sudetine vidines kokybes uztikrinimo 
sistemos dalis. Labai svarbu, kad j savianaliz^ 
kuo aktyviau jsitrauktp studentai kaip studijp 
paslaugi^ gavejai. Paprastai pagrindinis savia- 
nalizes trukumas yra tas, kad ji rengiama iso- 
riniams vertintojams, o ne sau patiems, visq 
pirma savo vidiniam vartojimui“ (Stumbrys, 
2004, p. 162). 

Ir vidinis, ir isorinis jvertinimas gali 
buti formuojamasis arba apibendrinama- 
sis. Formuojamasis atliekamas planuojant 
tarn tikr^ veikl^ arba tos veiklos eigoje. 


is defined as dedsion making, i.e. judgement 
saying whether the objed is good or bad, con- 
forming or not to the set goals, requirements 
or customer satisfaction (Dienys, Pukelis, 
Ziliukas, 2005; Savickiene., 2005; Gurskiene, 
2004; Kraujutaityte, 2003; Arends, 1998; Gage, 
Berliner, 1994; and other authors). 

The evaluation of colleges can be inter- 
nal or external. When the first one is carried 
out, the community of the higher school are 
judging on the quality of the institution and 
making decisions due to its work improve- 
ment. External evaluation is a decision by in- 
dependent experts on the quality of the work 
of the higher school {Quality Assurance and 
Accreditation: A Glossary of Basic Terms and 
Definitions, 2004). Results of internal evalua- 
tion are presented in the self-evaluation report 
(in practice, it is often called a self-analysis re- 
port or just self-analysis) that reveals the key 
strengths and weaknesses of the college under 
the most significant parameters of its work. 
Subsequently, the action improvement plan is 
scheduled on the basis of those results. In the 
course of external evaluation, individuals out- 
side the colleges community analyse its self- 
evaluation report, visit the college, evaluate the 
quality of its work, and provide recommenda- 
tions for quality improvement. “Self-analysis is 
not only the first part of external assessment 
but it is a constituent part of an internal quality 
assurance system. It is very important that the 
students, as recipients of study services, took 
an active part in the process of self-analysis. 
Usually the main drawback of self-analysis is 
that it is prepared for external assessors, not 
for themselves, not for internal use” (Stum- 
brys, 2004, p. 162). 

Both internal and external evaluation can 
be formative or summative. The first one is 
performed while an activity is being planned 
or in the course of the activity, with the inten- 
tion to identify what needs to be improved, 
whereas summative evaluation is carried out 
when some activity has been completed, with 
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siekiant issiaiskinti, k^ reikia patobulinti, 
o apibendrinamasis jvertinimas taikomas 
kokiai nors veiklai pasibaigus, kai siekiama 
nustatyti jos kokyb^ (Patry, Gastager, 2004; 
Arendsas, 1998; Gage, Berliner, 1994). Iso- 
rinis jvertinimas, kurj inicijuoja studijp 
kokybes uztikrinimo agenturos, yra dau- 
giau apibendrinamojo pobudzio. Kolegijos 
bendruomenes inicijuotas isorinis jvertini- 
mas, kai ji pasikviecia nepriklausomus sa- 
lies arba uzsienio ekspertus, dazniau buna 
formuojamasis. 

Vidinis ir isorinis jvertinimas yra tarpu- 
savyje glaudziai susij^: „vidinio vertinimo 
kokybe turi jtakos isoriniam vertinimui, o 
isorinis netiesiogiai svarbus vidiniam ver- 
tinimui, nes nurodo vertinimo kriterijus, 
pagal kuriuos mokykla pati vertins savo vei- 
kl^, produktus ir kt. Sip vertinimp derme 
sudaro s^lygas objektyvesniam jvertinimui“ 
(Zibeniene, Stasiulioniene, 2006, p. 128). 
Nors vidinio ir isorinio jvertinimo tiksluose 
gali buti akcentuoti skirtingi dalykai, tarp jp 
taip pat egzistuoja s^sajos. M. Barkauskaite 
ir R. Bruzgeleviciene (2002) issamiai apta- 
ria skirtingus jvertinimo tikslus, tarp kurip 
pastebima aiski derme. Pavyzdziui, isoriniu 
jvertinimu siekiama parodyti, kaip svietimo 
jstaigai, atsizvelgiant j jos socialinj, kultu- 
rinj kontekst^, paskirtj, sekasi jgyvendinti 
bendruosius ugdymo ir saviugdos tikslus 
bei uzdavinius; o vidiniu jvertinimu siekia- 
ma nusistatyti, kaip jstaigai, atsizvelgiant j 
jos kontekst^, paskirtj, sekasi jgyvendinti 
valstybiniq dokumentp iskeltus bendruosius 
asmens ugdymo ir saviugdos tikslus, verty- 
bes ir principus. Siuo atveju jvertinant abiem 
budais akcentuojamas atitikimas ugdymo ir 
saviugdos tikslams. Kitas isorinio ir vidinio 
jvertinimo tikslas iskelia objektyvios infor- 
macijos teikimo svarb^: suteikti objektyvi^ ir 
tiksli^ informacij^ apie konkrecios svietimo 
jstaigos kokyb§ svietimo klientams, tevams, 
visuomenei, jstatymq lydimqjq aktp nusta- 
tyta tvarka (isorinis jvertinimas); suteikti 


the intention to determine its quality (Patry, 
Gastager, 2004; Arends, 1998; Gage, Berliner, 
1994). External evaluation that is initiated by 
a higher education quality assurance agency is 
mostly of a summative kind. External evalua- 
tion initiated by a college community, when it 
invites independent experts from the country 
or abroad, is usually formative. 

Internal and external evaluation is closely 
interrelated: “the quality of internal assessment 
has an impact on external assessment, and ex- 
ternal one is indirectly important for internal 
assessment, as it determines the assessment 
criteria that will be applied by a school in the 
assessment of its work, products, etc. The co- 
herence between those two types of assessment 
provides opportunities for more impartial 
evaluation” (Zibeniene, Stasiulioniene, 2006, 
p. 128). Even if internal and external evalua- 
tion goals stress different issues, they also have 
correlations. Barkauskaite and Bruzgeleviciene 
(2002) discuss different goals of evaluation in 
detail, and among them a distinct relation is 
noticeable. For example, external evaluation 
intends to demonstrate how an educational in- 
stitution, regarding its social, cultural context 
and mission, is successful to realise general 
goals and aims of education and self-develop- 
ment, whereas internal evaluation intends to 
identify how an institution, regarding its con- 
text and mission, is successful to realise gen- 
eral goals, values and principles of individuals 
education and self-development stated in the 
national documents. In both cases, the two 
types of evaluation underline the conformance 
to education and self-development goals. One 
more goal of external and internal evaluation 
highlights the delivery of unbiased informa- 
tion: to deliver unbiased and precise informa- 
tion on the quality of the particular educa- 
tional institution to the education customers, 
parents and society in line with the order set 
in the acts following the related laws (external 
evaluation); to deliver unbiased information 
on the status of an educational institution or 
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objektyvi^ informacij^ apie svietimo jstaigos 
ar jos atskirp sriciq bukl^ savo jstaigos klien- 
tams (vidinis jvertinimas). 

Aukstojo mokslo sistema gali buti jver- 
tinama jvairiais aspektais: institucijLj, studi- 
ji^ prograiruj ir dalykq, teminiu ir konkreciq 
asmeni^ veiklos. Siame straipsnyje apta- 
riamas kolegiji^ jvertinimas priskiriamas 
pirmajam aspektui - juo parodoma, kad 
atliekamas institucijq veiklos tyrimas, kurio 
metu aiskinamasi visq veiklq aukstojoje neu- 
niversitetineje mokykloje kokybe, apimant 
kolegijos valdym^, finansiniij ir materiali- 
niq istekliq palaikym^, tarptautiniq rysiq 
pletojim^ ir kitas veiklas. jvertinimo turinj 
lemia tai, kokia kokybes koncepcija jis yra 
grindziamas. Jei kolegijos kokybe suvokia- 
ma kaip atitikimas tikslams, pastarieji tam- 
pa jvertinimo pagrindu: tiriamas kolegijos 
veiklos ir jos rezultati^ suderinamumas su 
institudjos misija ir strateginiais tikslais bei 
uzdaviniais, kurie keliami kolegijoms jq vei- 
kl^ reglamentuojanciuose nadonaliniuose 
salies ir tarptautiniuose dokumentuose. Jei 
kolegijos kokybe laikoma atitikimas reika- 
lavimams, aukstosios mokyklos jvertinimo 
metu aiskinamasi, ar jos veikla ir pasiekti 
rezultatai dera su juos apibudinandais stan- 
dartais (reikalavimais). Kai kolegijos kokybe 
siejama su atitikimu vartotoji^ poreikiams, 
pastarieji vadinami institucinio jvertinimo 
pagrindu ir tiriama, ar kolegijoje vykstan- 
tys procesai bei jos veiklos pasiekimai ten- 
kina isorinip ir vidiniq paslaugq vartotojq 
poreikius. 

Apibendrinant galima teigti, kad kolegi- 
jos isorinis jvertinimas - kolegijos bendruo- 
menei nepriklausandp asmenq atliekamas 
vertinimas ir, remiantis jo rezultatais, nutari- 
mo priemimas apie institucijoje sudarytq stu- 
dijp s^lygp tinkamum^ parengti spedalistus, 
orientuotus j praktin^, mokslo ir technologijq 
naujovemis pagrjst^ profesin^ veikl^. 


its various adivity areas to the customers of 
this institution (internal evaluation). 

Evaluation of different types is conducted 
in the system of higher education: institu- 
tional, study programme and subject, thematic 
and evaluation of some individual work. The 
evaluation of colleges that is discussed in this 
article belongs to the first type. It involves the 
research of the institutions work to identify 
the quality of all the activities performed in the 
non-university higher school, including the 
management of the college, maintenance of 
financial and material resources, development 
of international relations and other activities. 
The content of evaluation is determined by the 
quality conception, on which the evaluation is 
based. If the quality of the college is perceived 
as the conformance to goals, the goals become 
the basis of evaluation: the study focuses on the 
conformance of the work and results of the col- 
lege to its mission, strategic goals and aims that 
have been defined in the national and interna- 
tional documents regulating the college work. 
If the quality of the college is treated as the con- 
formance to requirements, evaluators of the 
higher education institution check whether the 
activities completed and results achieved con- 
form to the standards (requirements) that have 
defined them. If the quality of the college is 
meant as the conformance to consumer needs, 
they become the basis of the institutional eval- 
uation that examines if the processes in the 
college and its achievements meet the needs of 
external and internal consumers. 

To summarise, we might state that the 
external evaluation of the college is the assess- 
ment by individuals outside the colleges com- 
munity and, following the results of this as- 
sessment, their judgement on the quality of the 
college’s work, with regard to the conformance 
of the opportunities provided in the institution 
to develop professionals for practical work ap- 
plying science and technological innovations. 
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2 

EUROPOS AUKSTgjg MOKYKig 
ISORINIO IVERTINIMO PROCESAS 

Auksti|ji| mokyklij isorinio jvertinimo proce- 
sas daugelyje Europos saliq yra panasus. Eu- 
ropos aukstojo mokslo kokybes uztikrinimo 
tinklo (toliau - ENQA) parengtos apzvalgos 
{Mapping external quality assurance in Cen- 
tral and Eastern Europe, 2006; Quality Con- 
vergence Study, 2005; Accreditation Models in 
Higher Education, 2004; Quality Procedures 
in European Higher Education, 2003) jrodo, 
kad isorinis jvertinimas dazniausiai apima 
penkis etapus: pasirengim^ aukstpjp moky- 
klp isoriniam jvertinimui, aukstosios moky- 
klos parengtos jsivertinimo ataskaitos tyrim^, 
isorinio vertinimo vizit^, isorinio jvertinimo 
ataskaitos parengim^ ir paskelbim^, procedu- 
ras uzbaigus isorinj jvertinim^. Tai - ciklinis 
procesas (1 pav). 

Zemiau issamiau aptariama instituci- 
isorinio jvertinimo struktura - pagrin- 
dines proceduros, atskleidziancios jo etapp 
parametrus. 

Pasirengimas institucijif isoriniam 
fvertinimui apima sias pagrindines proce- 
duras: isorinio jvertinimo tikslo jvardijim^, 
proceso planavim^, jvertinimo reikalavimp 
formulavim^, jvertintojp mokymus, auks- 
tosios mokyklos jsivertinimo ataskaitos 
ir kitp jvertinimui reikalingp dokumentp 
parengim^. 

Rengiantis isoriniam jvertinimui pir- 
miausia yra apibreziamas jo tikslas: at- 
siskaitomybe, tobulinimas, informavimas, 
palyginamumas arba viename isorinio 
jvertinimo etape derinami keli tikslai. Po 
to numatomas isorinio jvertinimo mo- 
delis ir jis teisiskai jforminamas. Veliau 
pradedamas planuoti isorinio jvertinimo 
procesas: t. y. sudaromas vertinimo vizitp 
tvarkarastis, planuojami zmogiskieji, ma- 
terialiniai ir finansiniai istekliai. Dazniau- 
siai aukstpjp mokyklp isorinis jvertinimas 


2 

EXTERNAL EVALUATION PROCESS 
OF EUROPEAN HIGHER SCHOOLS 

The external evaluation of higher schools is 
similar with regard to its process in most Eu- 
ropean countries. The surveys (Mapping ex- 
ternal quality assurance in Central and Eastern 
Europe, 2006; Quality Convergence Study, 2005; 
Accreditation Models in Higher Education, 2004; 
Quality Procedures in European Higher Educa- 
tion, 2003) presented by the European Associa- 
tion for Quality Assurance in Higher Education 
(ENQA) demonstrate that institutional evalu- 
ation most often is structured of five stages: 
the preparation for the external evaluation of 
higher schools, the study of the self-evaluation 
report prepared by the higher school, an exter- 
nal assessment visit, the preparation and an- 
nouncement of the external evaluation report, 
the follow-up procedures of external evalua- 
tion. It is a cyclic process (Fig. 1). 

Below the structure of external institu- 
tional evaluation is discussed in more detail 
presenting the main procedures that reveal the 
parameters of evaluation stages. 

The preparation for external institu- 
tional evaluation includes the following main 
procedures: the identification of the external 
evaluation goal, the planning of the process, 
the setting of the evaluation requirements, the 
training of evaluators, the production of the 
self-evaluation report and other related docu- 
ments of a higher school. 

First of all, the preparation for the exter- 
nal evaluation at the sector level includes the 
definition of its goal: accountability, improve- 
ment, information, comparability or match- 
ing of several goals in one stage of external 
evaluation. Next, the model of external evalu- 
ation is chosen and legally documented. Af- 
terwards, the planning of external evaluation 
process starts: the timetable of assessment vis- 
its is scheduled, and human, material as well 
as financial resources are planned ahead. The 
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vyksta periodiskai, kas 5-7 metus. Jj atlie- 
ka atrinkti jvairip sricip specialistai, kurie 
rengiami ekspertais pagal specialias moky- 
mo programas ir vdiau jrasomi j isorinio 
kokybes uztikrinimo agenturos sudary- 
eksperti^ duomenp bank^. Pirmajame 
etape si agentura parengia reikalavimus 
aukstosioms mokyklos bei isoriniams 
jvertintojams: jvertinamai institudjai nu- 
rodoma kaip, kada ir koki^ informacij^ ji 
turetp pateikti, o jvertintojams sudaromos 


external evaluation of higher schools is usu- 
ally carried out in the period from 5 to 7 years. 
It is performed by professionals of different 
fields who are trained as experts according to 
special training programmes, and later, the 
external quality assurance agency includes 
them in its expert database. In the prepara- 
tion stage, this agency sets requirements for 
higher schools and external evaluators: the 
institution being evaluated is told how, when 
and what information it should deliver, while 



1 pav. Auksti|ji| mokykli) isorinio jvertinimo proceso etapai 
Fig. 1 . Stages of external evaluation process of higher schools 
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metodines rekomendadjos, kaip ir kokj 
darb^ jie turi atlikti isorinio jvertinimo 
metu. 

Viena is svarbiausiq pasirengimo etapo 
procedure yra aukstosios mokyklos jsiver- 
tinimo ataskaitos ir kitp jvertinimui reika- 
lingp dokumentp parengimas. Ataskaita - 
institudjos isorinio jvertinimo pagrindas, 
be kurio sis procesas is prindpo negalimas. 
Akcentuotina tai, kad isorinio jvertinimo 
ataskaita yra nuolatinio institucijos vidinio 
jsivertinimo dalis. J jos rengejq komandas 
dazniausiai yra jtraukiami visp aukstosios 
mokyklos kokybe suinteresuotp grupip at- 
stovai: studentai, vadovybe, administracija 
ir destytojai, techninis personalas ir kt. Jsi- 
vertinimo ataskaitos atlikimo ir pateikimo 
isoriniam jvertinimui reglamentavimo lygis 
jvairiose salyse skiriasi, pavyzdziui, Norve- 
gijoje, Suomijoje ir Svedijoje sie dokumentai 
yra rengiami taip, kad butq naudingi paciai 
institucijai, juose identifikuojami savo vei- 
klos privalumai ir trukumai bei numatomi 
kokybes gerinimo prioritetai. Airip ir britp 
jsivertinimo modeliai yra daugiau hierar- 
chines strukturos, juose koncentruojamasi 
j organizacinius aspektus. Lietuvoje jsiver- 
tinimo ataskaita, skirta isoriniam jvertini- 
mui, yra pateikiama pagal Studijp kokybes 
vertinimo centro (toliau - SKVC) nustatyt^ 
form^ ir atitinkamus reikalavimus, o kole- 
gijp veiklos kokybes isoriniam jvertinimui 
be pagrindinio tikslo - jvertinti kolegijos 
veiklos kokyb^ ir parengti jos veiklos tobu- 
linimo rekomendadjas, yra keliamas ir spe- 
cifinis tikslas - jvertinti kolegijos pazang^, 
padaryt^ nuo jos jsteigimo ir suformuluoti 
jvertinamuosius sprendimus del nuolatinio 
statuso suteikimo {Kolegiji^ veiklos kokybes 
vertinimo tvarkos aprasas, 2006). 

Aukstosios mokyklos parengtos jsi- 
vertinimo ataskaitos tyrimas apima infor- 
macijos apie institucijoje sudarytas studi- 
s^lygas rinkim^, analiz^ ir sisteminim^, 
remiantis nustatytomis veiklos sritimis 


evaluators receive methodical recommenda- 
tions, explaining how and what tasks should 
be completed in external evaluation. 

In the preparation stage, one of the most 
essential procedures is the production of the 
self-evaluation report and other related docu- 
ments of a higher school. The report is the 
basis for external institutional evaluation, and 
this process is impossible without the report. 
It is necessary to emphasise that the report for 
external evaluation is a part of continuous in- 
ternal institutional evaluation. Teams of report 
writers usually include the representatives of 
all the groups interested in the quality of the 
higher school: students, school managers, ad- 
ministrators and lecturers, technical staff and 
others. In various countries, the difference lies 
in the regulation level to complete the self- 
evaluation report and deliver it for external 
evaluation. For example, in Norway, Finland 
and Sweden, those documents are prepared so 
that to be valuable for the institution itself with 
the identification of strengths and weaknesses 
as well as quality improvement priorities. The 
Irish and British self-evaluation models are 
more of a hierarchical structure with the fo- 
cus on organisational aspects. In Lithuania, 
the self-evaluation report intended for exter- 
nal evaluation is presented according to the 
format and relevant requirements set by the 
Centre for Quality Assessment in Higher Edu- 
cation (CQAHE), and the external evaluation 
of the quality of the colleges has two purposes. 
The main purpose is to evaluate the quality of 
the colleges’ work and provide recommenda- 
tions for its improvement, while the specific 
aim is to evaluate the progress of the college 
achieved since its establishment, and provide 
evaluative decisions concerning the award of 
the regular status as a college (Kolegiji^ veiklos 
kokybes vertinimo tvarkos aprasas/The Set of 
the Assessment Order for the Quality of the Col- 
leges’ Work, 2006). 

The study of the self-evaluation report 
prepared by the higher school includes data 
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(kokybes dimensijomis); ataskaitoje pateiktq 
argument^ svarumo jvertinim^; aukstosios 
mokyklos pazangos jvertinim^ ir kitas ze- 
miau aptartas proceduras. 

Isivertinimo ataskaitose ir kituose isori- 
niam jvertinimui skirtnose dokumentuose 
aukstoji mokykla pateikia informacij^ pagal 
tam tikras veiklos sritis (kokybes dimensijas). 
Lietuvoje kolegijos, besiruosdamos isoriniam 
jvertinimui, savo veikl^ analizuoja pagal 
9 veiklos sritis: valdym^, studijp planavim^ ir 
organizavim^, mokslo taikomuosius tyrimus 
ir rysius su partneriais Lietuvoje, tarptautinj 
bendradarbiavim^, personal^, materialinius 
ir finansinius isteklius, vidin^ kokybes uzti- 
krinimo sistem^, absolventp kvalifikacijos 
jgijimo vertinimo sistem^ ir rengiami^ specia- 
listij paklaus^. 

Daugelio Europos salii^ auksti^ji^ moky- 
klq isorinio jvertinimo procese naudojami 
statistiniai duomenys, atspindintys jvairiq 
institudjos veiklos sridij bukl^. 1 lenteleje 
pateikti ENQA atlikto tyrimo {Quality Pro- 
cedures in European Higher Education, 2003), 
kuriame dalyvavo 34 kokybes uztikrinimo 
agenturos, rezultatai. Jie parodo, kad atliekant 


gathering, systematisation and analysis regard- 
ing the study opportunities provided in the in- 
stitution on the basis of the defined work areas 
(quality dimensions); the evaluation of the va- 
lidity of evidence presented in the report; the 
evaluation of the progress made by the higher 
school and other procedures described below. 

The self-evaluation reports and other doc- 
uments for external evaluation include the data 
provided by the higher school on its work areas 
(quality dimensions). In Lithuania, the colleges 
preparing for external evaluation analyse their 
work in accordance with 9 work areas: man- 
agement, planning and organisation of studies, 
applied science research and communication 
with partners in Lithuania, international coop- 
eration, staff, material and financial resources, 
internal quality assurance system, the assess- 
ment system of graduates’ qualification acqui- 
sition and demand of trained professionals. 

In most European countries, the external 
evaluation of higher schools use statistical data 
revealing the quality of different institutional 
work areas. Table 1 presents the results of 
the research {Quality Procedures in European 
Higher Education, 2003) organised by ENQA 


1 lentele. Statistiniqduomenq tipai ir jq naudojimo daznumas Europos aukstqjq mokykiq 

isorinio jvertinimo procese 

Table 1. Types of statistical data and frequency of their use in external evaluation of 

European higher schools 


EIL. 

NR. 

NO. 

STATISTlNiy DUOMENV TIPAl 
TYPES OF STATISTICAL DATA 

STATISTINiy DUOMENV NAUDOJIMO 
DAZNUMAS, PROC.» 
FREQUENCY OE STATISTICAL DATA 
USE, (%)’^ 

1. 

Statistiniai duomenys apie studentus 
Statistical data on students 

100 

2. 

Statistiniai duomenys apie aukstosios mokyklos finansus 
Statistical data on financial information of the higher school 

61 

3. 

Statistiniai duomenys apie administracijos personal^ 
Statistical data on administrative staff 

61 

4. 

Statistiniai duomenys apie akademinj personal^ 
Statistical data on academic staff 

90 

5. 

Darbo rinkos statistiniai duomenys 
Labour market statistics 

61 


* duomenis pateike 31 is 34 apklausoje dalyvavusiij kokybes uztikrinimo agenturij / 

data was presented by 31 quality assurance agencies among 34 ones that participated in the survey 
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jvertinim^ dominuoja statistiniai duomenys 
apie pagrindinius studijq proceso dalyvius - 
studentus (100 proc.) ir akademinj aukstosios 
mokyklos personal^ (90 proc.). 

Apibendrinant duomenq, analizuojamp 
atliekant Europos aukstqjp mokyklp isori- 
nj jvertinim^, pobudj galima isskirti siuos 
desningumus (Mapping external quality 
assurance in Central and Eastern Europe, 
2006): 

1) institucij^ jvertinant pirm§ kart^, di- 
desnis demesys yra skiriamas istekliams ir 
s^naudoms, panaudotoms siekiant gauti ati- 
tinkamus rezultatus: analizuojama, kaip ins- 
titucija pasirengusi savo veiklai, tiriamas jos 
misijos pagrjstumas, materialinip ir finansi- 
niq isteklip, personalo kokybe ir pan.; 

2) adiekant pakartotinj institucijos jver- 
tinim^, didesnis demesys skiriamas pasiek- 
tiems rezultatams: analizuojamas institucijos 
misijos ir tikslq pasiekimo lygis; valdymo ir 
studijq kokybes uztikrinimo mechanizmp 
veiksmingumas ir pan. 

Isoriniai jvertintojai, analizuodami 
aukstosios mokyklos jsivertinimo ataskai- 
tose ir kituose susijusiuose dokumentuose 
pateikt^ informacij^, siekia sip pagrindinip 
tikslp: jvertinti argumentp, pagrindziancip 
institucijos jvardytus veiklos privalumus 
ir trukumus, svarum^; jvertinti aukstosios 
mokyklos pazang^ per tarn tikr^ laikotarpj 
bei jp parodytas pastangas kokybei gerinti; 
jvertinti veiksmp piano kokybei gerinti pa- 
grjstum^ nurodytiems trukumams pasalinti; 
nustatyti problemines arba neaiskiai apibu- 
dintas kolegijos veiklos sritis; sudaryti pa- 
pildomai analizei reikalingos informadjos ir 
dokumentp s^ras^, kurj jvertinama institu- 
cija turetp pateikti isoriniams jvertintojams 
vizito metu. 

Lietuvoje kolegijp isoriniai jvertintojai is 
pradzip dokumentus analizuoja individua- 
liai, po to pries vizit^ (ne veliau kaip 3 savai- 
tes iki vizito pradzios) SKVC rengia jvertin- 
tojp grupes parengiampjj posedj, kurio metu 


with the participation of 34 quality assurance 
agencies. The results demonstrate that statisti- 
cal data on the main actors of the study process 
are dominating in evaluation, i.e. information 
on students (100%) and academic staff (90%) 
of the higher school is prevailing. 

To generalise the nature of the data analy- 
sed in the external evaluation of the European 
higher schools, the following regularities might 
be identified (Mapping external quality assur- 
ance in Central and Eastern Europe, 2006): 

1) The first institutional evaluation more 
focuses on the resources and inputs for the 
achievement of results: the readiness of the 
institution to perform its activities is analysed, 
i.e. the relevance of the mission, the quality of 
material and financial resources, its staff and 
other issues are covered. 

2) The successive institutional evaluation 
gives more attention to the results achieved: 
it includes the level at which the mission and 
goals have been attained, the effectiveness of 
management, the quality assurance mecha- 
nisms of higher education, etc. 

External evaluators analyse the data pro- 
vided by higher schools in self-evaluation re- 
ports and other related documents, and their 
main aims are as follows: to evaluate the validity 
of evidence demonstrating strengths and weak- 
nesses presented by the institution; to evalu- 
ate the progress of the higher school made in a 
certain period and its endeavours to improve 
quality; to evaluate the relevance of the quality 
improvement plan to eliminate the identified 
weaknesses; to determine problematic or vaguely 
described areas of the colleges work; to compile 
the list of the required supplementary data and 
documents that should be provided by the insti- 
tution for external evaluators during the visit. 

In Lithuania, the external evaluators of 
colleges analyse documents independently at 
first, and before the visit (not later than 3 weeks 
to the beginning of the visit), CQAHE organ- 
ise the preparation meeting of the evaluators’ 
team to discuss the questions of the evaluation 
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aptariami jvertinimo turinio ir vizito j kole- 
gij 4 proceduriniai klausimai: grupes nariai 
pasidalija atsakomybe del konkrecip veiklos 
sriciq jvertinimo, aptaria kolegijos veiklos 
probleminius klausimus pagal jos pateikt^ 
jsivertinimo ataskait^, sudaro papildomi^ do- 
kumentij ar kitos jvertinimui reikalingos in- 
formacijos s^ras^, aptaria vizito darbotvark^ 
ir kitus jvertinimo aspektus. 

Borinio vertinimo vizito metu tikrinama 
ir tikslinama aukstosios mokyklos jsiverti- 
nimo ataskaitoje pateikta informacija ir fak- 
tai apie jos veiklos privalumus ir trukumus, 
renkami papildomi duomenys ir argumen- 
tai, kurip pagrindu rengiami jvertinamieji 
sprendimai, padedama institudjai apsibrezti 
savo veiklos tobulinimo tikslus, uzdavinius ir 
veiksmus. 

Vertinimo vizito trukme daugelyje Eu- 
ropos saliq yra nuo 2 iki 5 dienp. Ji priklau- 
so nuo aukstosios mokyklos dydzio, veiklos 
sudetingumo ir kokybes uztikrinimo agen- 
turos naudojamp jvertinimo budij visumos. 
Pavyzdziui, dideleje kolegijoje, turincioje 
daug strukturiniij padalinip ir jvairiq studi- 
jq krypciq studijp programas, vizito trukme 


content and procedures of the visit. The team 
members share responsibility for the evalu- 
ation of particular work areas of the college, 
they discuss problematic issues with regard 
to the self-evaluation report of the college, 
compile the list of the required supplementary 
documents or data, discuss the timetable of 
the visit and other evaluation aspects. 

An external assessment visit includes the 
revision and verification of the data and evi- 
dence given in the self-evaluation report of the 
higher school, the collection of new data and 
evidence which are the basis to make evaluative 
decisions, the assistance for the institution to de- 
fine its improvement goals, tasks and actions. 

In many European countries, the dura- 
tion of an assessment visit varies from 2 to 
5 days, depending on the size of a higher 
school, the complexity of its work and evalu- 
ation methods used by a quality assurance 
agency. For example, the visit lasts for 5 days 
in a large college with many structural divi- 
sions and programmes of various study fields, 
while the duration of the visit is from 2 to 3 
days in a small institution (meaning both the 
organisational aspect and the variety of study 


2 lentele. Vertinimo vizito aukstojoje mokykioje metu taikomos procedures ir ji| daznumas Europos salyse 
Table 2. Procedures and their frequency in higher school's assessment visit in European countries 


EIL. 

NR. 

NO. 

VERTINIMO VIZITO METU TAIKOMOS PROCEDUROS 
PROCEDURES OE ASSESSMENT VISIT 

PROCEDURV 
DAZNUMAS, PROC. » 
FREQUENCY OF 
PROCEDURES, (%)* 

1. 

Interviu / pokalbis su aukstosios mokyklos bendruomenes atstovais 
Interview/conversation with representatives of assessed institution 

100 

2. 

Studijq uzsiemimi} stebejimas 
Classroom observations 

20 

3. 

Studijoms skirtq istekliq apziura 
Tours of facilities for studies 

87 

4. 

Baigiamasis vertintojq susitikimas su aukstosios mokyklos vadovybe 
Final meeting of evaluators with management of higher school 

73 

5. 

Dokumentuose (jsivertinimo ataskaitoje ir kituose) pateiktq duomenq 
tikrinimas 

Examination of evidence in documents (self-evaluation report and others) 

90 


* duomenis pateike 30 is 34 apklausoje dalyvavusiij kokybes uztikrinimo agentunj / 

data was presented by 30 quality assurance agencies among 34 ones that participated in the survey 
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yra 5 dienos, o mazoje (tiek organizacine, tiek 
studijq programq jvairoves prasme) - vizitas 
trunka nuo 2 iki 3 dienp. Vizito metu susitin- 
kama su aukstosios mokyklos bendruomene 
ir su ja bendradarbiaujancip institucijp at- 
stovais, apziurimi studijoms skirti materiali- 
niai ir metodiniai istekliai, susipazjstama su 
jvertinimui reikalingais papildomais doku- 
mentais, organizuojami isorinip vertintojp 
uzdari ir atviri posedziai ir kt. Europos salyse 
vertinimo vizitp metu aukstosiose mokyklose 
dazniausiai taikomos sios proceduros {Quali- 
ty Procedures in European Higher Education, 
2003): interviu (pokalbis) su vertinamos ins- 
titudjos bendruomenes atstovais (100 proc.), 
dokumentuose pateiktp jrodymp tikrinimas 
(90 proc.) ir studijoms skirtp isteklip apziura 
(87 proc.; 2 lentele). 

Isorinio fvertinimo ataskaitos paren- 
gimas ir paskelbimas. Remiantis aukstosios 
mokyklos jsivertinimo ataskaitoje ir kituose 
dokumentuose pateikta informacija bei vizi- 
to metu surinktais duomenimis, jvertinimo 
ataskaita rengiama keliais etapais: 

• parengiamas isorinio jvertinimo atas- 
kaitos projektas, kuris aptariamas su auksto- 
sios mokyklos atstovais vizito metu; 

• jvertinimo ataskaitos projektas tobu- 
linamas pagal gautas jvertintos institucijos 
pastabas; 

• parengiamas galutinis jvertinimo atas- 
kaitos variantas ir apsvarstomas kokybes uz- 
tikrinimo agenturos patariancipjp institucijp 
posedziuose; 

• viesai skelbiama jvertinimo ataskaita 
kokybes uztikrinimo agenturos ir / ar svieti- 
mo ministerijos leidziamuose leidiniuose bei 
tinklapiuose. 

Skirtingose Europos salyse atsakomybe 
uz jvertinimo rezultatp pateikim^ jvertinto- 
jai ir kokybes uztikrinimo agenturos dalija- 
si nevienodai. Rengiant ataskaitas, didesne 
atsakomybe tenka jvertintojams, taciau kai 
kuriais atvejais sis jpareigojimas tenka agen- 
turp darbuotojams. Tokiais atvejais pastarieji 


programmes). The visit includes different 
procedures: meetings are held with the com- 
munity of the higher school and representa- 
tives of the cooperative institutions, material 
and methodical resources for studies are ex- 
amined, additional documents for the evalu- 
ation are reviewed, closed and open meetings 
of external assessors are organised, etc. In the 
European countries, assessment visits usu- 
ally involve the following procedures: {Qual- 
ity Procedures in European Higher Education, 
2003): an interview (conversation) with the 
representatives of the community of the as- 
sessed institution (100%), the examination of 
the documentary evidence (90%) and the tour 
of the facilities for studies (87%, Table 2). 

The preparation and announcement of 
the external evaluation report. Considering 
the data provided by the higher school in the 
self-evaluation report and other documents as 
well as evidence collected in the assessment 
visit, the evaluation report is prepared in sev- 
eral stages: 

• the draff of an external evaluation report 
is prepared and discussed with the representa- 
tives of the higher school during the visit; 

• the draff of the evaluation report is re- 
viewed with regard to comments of the evalu- 
ated institution; 

• the final version of the evaluation report is 
prepared and discussed in the meetings of the ad- 
visory bodies for the quality assurance agency; 

• the evaluation report is published as a 
printed document or posted on web pages by 
the quality assurance agency or/and the min- 
istry of education. 

In various European countries, the respon- 
sibility for the presentation of the evaluation 
results is differently shared between evaluators 
and the quality assurance agency. The major re- 
sponsibility for the preparation of reports goes 
to evaluators, however occasionally this obliga- 
tion falls for the employees of an agency. In such 
cases, the latter ones are involved in evaluation 
groups as experts, not only as administrators for 
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yra jtraukiami j jvertintojq grupes kaip eks- 
pertai, o ne tikkaip vizitus administruojantys 
asmenys. Tolq modelj taiko Europos univer- 
sitetq asociacija, atliekanti isorinj aukstqjq 
mokyklij jvertinim^ visoje Europoje ir uz jos 
ribi|. Taciau jvertinimo ataskaiti^ viesinimas 
yra kokybes uztikrinimo agenturos pareiga ir 
atsakomybe. 

Europos salyse auksti^ji^ mokykl^ isori- 
nio jvertinimo ataskaitas dazniausiai sudaro 
trys elementai (Quality Procedures in Euro- 
pean Higher Education, 2003): 1) jvertina- 
moji isvada; 2) analitine dalis - institudjos 
veiklos privalumq ir trukumq analize; 3) re- 
komendacijos tobulinimui skirtingais lygme- 
nimis - nadonaliniu (rekomendacijos jverti- 
nimo proceso ir aukstojo mokslo sektoriaus 
tobulinimui salies mastu) ir / arba aukstosios 
mokyklos (rekomendadjos, skirtos jvertin- 
tos institudjos veiklos tobulinimui). Salyse, 
kuriose studiji^ uzsiemimai stebimi, isoriniai 
jvertintojai ataskaitoje taip pat pateikia savo 
surinktus duomenis. 

Proceduros pabaigus isorinj jvertini- 
mc} reikalingos stebeti ir uztikrinti tinkam^ 
isoriniij jvertintojq suformuluotq rekomen- 
dacijq jgyvendinim^. jvertintos institudjos 
bendruomene privalo savu laiku ir koky- 
biskai jgyvendinti suformuluotas rekomen- 
dacijas susiedama jas su veiklos kokybes 
tobulinimo planais (Quality procedures in 
European Higher Education, 2003). Proce- 
duras, skirtas isorinio jvertinimo proceso 
tobulinimui salies mastu, jgyvendina koky- 
bes uztikrinimo agenturos: surenka siame 
procese dalyvavusiq asmenij (jvertintij ins- 
titucijq atstovq, isoriniq jvertintojq, agen- 
turai patarianciqjij institucijij atstovij bei 
jvertinim^ organizavusip asmenq) atsiliepi- 
mus ir siulymus, juos apibendrina ir aptaria 
viesuose renginiuose. Toks dialogas butinas 
siekiant aukstqji^ mokyldi^ isorinio jvertini- 
mo skaidrumo. 


a visit. This model is applied in the European 
University Association, which carries out ex- 
ternal evaluation of higher schools in the entire 
Europe and outside. Nevertheless, the publica- 
tion of evaluation reports is the obligation and 
responsibility of a quality assurance agency. 

In the European countries, reports of the 
external evaluation of higher schools usually 
contain three elements (Quality Procedures 
in European Higher Education, 2003): 1) an 
evaluative conclusion; 2) an analytical part 
with the analysis of strengths and weaknesses 
of the institutions work; 3) recommendations 
for improvement at different levels - national 
(recommendations for the improvement of 
evaluation process and higher education sec- 
tor nationwide) and/or institutional (recom- 
mendations for the improvement of the work 
of the evaluated higher school). In countries 
where classroom observations are organised, 
the report of external evaluators also pres- 
ents the evidence collected during those 
observations. 

Ihe follow-up procedures of external 
evaluation are carried out to monitor and as- 
sure the appropriate implementation of rec- 
ommendations provided by external experts. 
The community of the evaluated institution 
must put recommendations in practice timely 
and meeting the quality standards as well as 
relating them to quality improvement plans 
(Quality procedures in European Higher Edu- 
cation, 2003). The quality assurance agency 
conduct the procedures for the improvement 
of the external evaluation process at the na- 
tional level: they collect reviews and sugges- 
tions by the participants of this process (the 
representatives of the evaluated institutions, 
external evaluators, agency’s advisory bodies 
and organisers of evaluation), summarise and 
discuss them in public events. Such a dialogue 
is necessary for the transparency of the exter- 
nal evaluation of higher schools. 
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3 

LIETUVOS KOLEGIjg ISORINIO 
IVERTINIMO PROBLEMOS IR jg 
SPRENDIMOGALIMYBES 

Siekiant issiaiskinti kolegij 4 isorinio jvertinimo 
problemas ir sprendimo galimybes, 2007 m. 
balandzio men. atliktas empirinis tyrimas: in- 
dividualaus diagnostinio pusiau standartizuoto 
pokalbio metai apklausta desimt asmenp, tiesio- 
giai dalyvaujancip jvertinimo procese - trys 
jvertinim^ organizuojantys asmenys, keturi 
isoriniai jvertintojai ir trys jvertintp kolegijp 
atstovai (vadovai ir uz kokybes uztikrinim^ 
kolegijoje atsakingi asmenys). Respondentai - 
aukstojo mokslo kokybes vadybos sistemos 
zinovai, dalyvav^ visuose kolegijp isorinio 
jvertinimo etapuose. Pokalbiui buvo parengti 
septyni pagrindiniai klausimai, o papildomi 
klausimai buvo formuluojami tais atvejais, kai 
buvo butina patikslinti respondentp atsaky- 
mus j klausimus ar juos isplesti. Sis tyrimo 
metodas pasirinktas siekiant atskleisti jvairip 
kolegijq isorinio jvertinimo proceso dalyvip 
poziurius, nuomones, nuostatas ir surinkti 
jvairi^, bet pagrjst^ diagnostin^ informacij^. 
Tyrimo duomenims apdoroti atlikta turinio 
(kontentine) analize, kuri taikoma tada, kai 
butina isanalizuoti ne tik tiriamo objekto 
raiskos tendendjas, bet kartu interpretuoti to 
objekto ir / ar problemos holistinj kontekst^ 
(Bitinas, 2006). 

Empirinio tyrimo metu atskleisti pagrin- 
diniai kolegijq isorinio jvertinimo etapus nu- 
sakantys parametrai, apibreztos kiekviename 
jvertinimo etape kylancios problemos, isrys- 
kintos esmines mineto proceso tobulinimo 
kryptys: 

1. Pasirengimas isoriniam jvertini- 
mui. Respondentai jvardijo tris pagrin- 
dinius sio etapo parametrus: isorinio 
jvertinimo tikslo numatymas; kolegijos 
jsivertinimo ataskaitos isoriniam jverti- 
nimui parengimas ir pateikimas kokybes 
uztikrinimo agenturai; isoriniq jvertintojp 


3 

PROBLEMS AND POSSIBILITIES FOR 
THEIR SOLUTION IN EXTERNAL 
EVALUATION OF LITHUANIAN COLLEGES 

To reveal problems and possibilities for their 
solution in the external evaluation of colleges, 
in April 2007 the empirical research was car- 
ried out: during individual diagnostic semi- 
standardised conversations ten individuals 
were questioned, and all of them had been 
direct participants of the evaluation process: 
three organisers of external evaluation, four 
external evaluators and three representatives 
of the evaluated colleges (heads and ones re- 
sponsible for quality assurance in the college). 
The respondents were proficient in the system 
of higher education quality management and 
had participated in all the stages of the external 
evaluation of colleges. Seven main questions 
had been prepared for the conversation, and 
supplementary questions were asked in cases it 
was necessary to specify or expand responses 
to the questions. That research method had 
been chosen to reveal views, opinions and at- 
titudes of different participants of the external 
evaluation of colleges, as well as collect vari- 
ous and valid diagnostic data. The research 
findings were arranged by content analysis to 
study expression trends of an object and in- 
terpret the holistic context of an object or/ and 
problem (Bitinas, 2006). 

The empirical research reveals the main pa- 
rameters of the stages structuring the external 
evaluation of colleges, defines problems met in 
each evaluation stage, and highlights the most es- 
sential improvement guidelines of this process: 

1. The preparation for external evalua- 
tion. The respondents have referred to three key 
parameters of this stage: the identification of an 
external evaluation goal; the preparation and 
delivery of the colleges self-evaluation report 
(intended for external evaluation) to the quality 
assurance agency; the appointment of external 
evaluators, the development and recognition of 
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parinkimas, jij gebejimp tobulinimas ir 
pripazinimas. {vertinimo tikslo reiksmin- 
gum^ parodo sios nuomonesb „tikslo nu- 
matymas yra labai svarbi jvertinimo agen- 
turos funkcija, nes nuo jo priklauso isorinio 
jvertinimo turinys ir proceduros", „ydingai 
suformuluotas jvertinimo tikslas gali ne pa- 
deti kryptingai kolegijif sektoriaus pletrai, 
bet atvirksciai - jq isbalansuoti arba net 
stabdyti". Respondentia atsakymai rodo, 
kad kolegijij isoriniam jvertinimui taiko- 
mq procedure modelio paskirtis atitin- 
ka aukstojo mokslo strateginiuose doku- 
mentuose apibrezt^ jvertinimo tiks4: „Ms 
modelis atitinka kolegijq jvertinimo tikslq, 
kuris yra suformuluotas LR Aukstojo moks- 
lo jstatyme", modeliu „siekiama jstatyme 
jvardyto tikslo - jvertinti kolegijos padarytq 
pazangq nuo jos jsteigimo pradzios, jvertin- 
ti jos kokyb^ bei nuspr^sti del jos tolimesnes 
veiklos tikslingumo", „taikomos proceduros 
atitinka isorinio kokybes vertinimo (jverti- 
nimo - aut.) tikslq". Vienas respondentas 
pateike siulym^ kelti naujus papildomus 
jvertinimo tikslus, kurie atspindetp kin- 
tancias nacionalines ir europines aukstojo 
mokslo kokybes uztikrinimo nuostatas. Sa- 
lia jvertinimo tikslo svarbos dar pabrezta ir 
kolegijos jsivertinimo ataskaitos reiksme: 
„savianalizes ataskaita yra isorinio jvertini- 
mo pagrindas", „be savianalizes joks isorinis 
jvertinimas nera prasmingas", „isoriniam 
jvertinimui skirta savianalizes ataskaita yra 
dalis kolegijq vidinio jvertinimo proceso". 
Kompetentingq isorinii^ jvertintojq (vadin- 
dami juos ekspertais) vaidmenj isoriniam 
jvertinimui respondentai pagrinde siomis 
nuomonemis: „isorinio jvertinimo kokybe 
svaria dalimi priklauso nuo ekspertq kom- 
petencijos (kompetentingumo - aut.), nuo 
jq objektyvumo", „ekspertq grupes turi buti 
suformuotos labai apgalvotai - butina, kad 


^ Respondent^ pasisakymuose lietuvii4 kalbos gramatika 
netaisyta. 


their abilities. The importance of an evaluation 
goal has been based on the following opinions: 
“the identification of a goal is a very important 
function of the evaluation agency as it conditions 
the content and procedures of external evalua- 
tion”, “a wrongly stated evaluation goal cannot 
assist in the purposeful development of the col- 
lege sector; on the contrary, it would impede or 
even stop the development”. The answers of the 
respondents show that the purpose of the pro- 
cedure model applied in the external evaluation 
of colleges corresponds to the evaluation goal 
defined in the higher education strategic docu- 
ments: “this model answers the college evaluation 
goal that has been set in the Law of Higher Edu- 
cation of the Republic of Lithuania”, the model 
“pursues the goal stated in the law, which says to 
evaluate the progress of the college achieved since 
its establishment, evaluate its quality and decide 
on the purposefulness of its future activities”, “the 
applied procedures agree with the goal of external 
quality assessment (evaluation - auth.)”. One 
respondent has suggested that supplementary 
and new evaluation goals could be defined to 
meet changing national and European guide- 
lines of higher education quality assurance. 
Next to the importance of an evaluation goal, 
the significance of the colleges self-evaluation 
report has been emphasised: “the self-analysis 
report is the basis for external evaluation”, “any 
external evaluation has no sense without the self- 
analysis”, “the self-analysis report intended for 
external evaluation is apart of the internal eval- 
uation process of the college”. The role of com- 
petent external evaluators (named as experts) 
in external evaluation has been expressed by 
the following opinions of the respondents: “the 
quality of external evaluation mostly depends on 
the competency (competence - auth.) of experts, 
on their impartiality”, “expert groups should 
be appointed very carefully as it is necessary to 
have equal discussions among the members of 
the expert group so that they could complement 
one another”, “it is essential to train experts for 
the work with specific assessment methodologies 
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tarp eksperti} grupes narii^ vykti^ lygiaver- 
tes diskusijos, vieni kitus galetif papildyti", 
„ypac aktualu ekspertus parengti darbui su 
konkreciomis vertinimo metodikomis, tai- 
kant nurodytus vertinimo kriterijus, rodi- 
klius bei vertinimo skales", „ne maziau uz 
eksperti^ metodinius gebejimus yra svarbus 
darbo komandoje gebejimai, kurie tureti} 
buti ugdomi ar stiprinami mokymi^ eksper- 
tams metu“. 

Respondentai pabreze, kad kolegijp isori- 
nio jvertinimo tikslai turi buti aiskus, kolegi- 
parengtos jsivertinimo ataskaitos tikslios, o 
jvertintojp gebejimai ispletoti. Manoma, kad 
visa tai galetp uztikrinti sie veiksmai: 

• formuluojant kolegijp isorinio jver- 
tinimo tiksl^ svarbu aiskiai nurodyti, ar 
jvertinimas atliekamas dd kolegijq veiklos 
kokybes gerinimo, ar del sip institucijp 
akreditavimo; 

• kokybes uztikrinimo agentura, ben- 
draudama ir bendradarbiaudama (konsul- 
tuodamasi) su kolegijp atstovais, turi siekti 
jp parengtos jsivertinimo ataskaitos turinio 
skaidrumo ir objektyvumo. Agenturai tiks- 
linga atlikti sios ataskaitos pirmin^ anali- 
zq, o nustacius neatitikimus reikalavimams 

reiketp gr^zinti kolegijai pataisyti ir tik 
pataisius organizuoti institudjos veiklos 
jvertinim^; 

• nuolat sistemingai organizuoti isori- 
nip jvertintojp mokymus ir jp kvalifikacijos 
pripazinim^. 

2. Kolegijos parengtos jsivertinimo 
ataskaitos tyrimas. Respondentp atsaky- 
mai isryskino du pagrindinius sio etapo 
ypatumus: dokumento analiz^ ir jo jverti- 
nim^ pagal kiekybinius ir kokybinius para- 
metrus; dokumento analiz^ ir jo jvertinim^ 
kokybes uztikrinimo sistemos kontekste. 
Apklaustpjp nuomones apie sio etapo pri- 
valumus ir trukumus issiskyre. Vieni teige, 
kad pagal kiekybinius ir kokybinius para- 
metrus galima gerai atlikti jsivertinimo 
atskaitos analiz^, nes dokumente pateikti 


applying the set of assessment criteria, indica- 
tors and assessment scales”, “methodical abilities 
of experts are as much important as team work 
abilities that should be developed or enhanced in 
the training sessions for experts”. 

The respondents have highlighted the need 
to define predse goals for the external evalua- 
tion of colleges, prepare exphdt self-evaluation 
reports of colleges and develop evaluators’ 
ahihties. They have suggested the following ac- 
tions for the assurance of those intentions: 

• to state the goal for the external eva- 
luation of colleges so that to clearly indicate 
whether the evaluation intends to improve the 
quality of the colleges’ work or accredit those 
institutions; 

• to aim at the transparency and impartia- 
lity of the self-evaluation reports of colleges by 
communication and cooperation (counselling) 
between the quality assurance agency and repre- 
sentatives of colleges. The agency might make 
the initial analysis of those reports, and if they 
find the unconformity with the stated require- 
ments, reports should be returned to colleges 
for the revision. Only when the review by the 
agency has been completed, the institutional 
evaluation by experts could be organised; 

• to constantly and systematically con- 
duct training for external evaluators and orga- 
nise the recognition of their qualification. 

2. The study of the self-evaluation report 
prepared by the college. The respondents’ an- 
swers have shown two main parameters of this 
evaluation stage: the analysis and evaluation of 
the report following quantitative and qualita- 
tive parameters; the analysis and evaluation 
of the document in the context of the qual- 
ity assurance system. The research participants’ 
views on the strengths and weaknesses of this 
stage have varied. Some of them have declared 
the analysis of the self-evaluation report can 
be properly carried out when quantitative and 
qualitative parameters are followed because in 
this case the document presents “evidence that 
is easily verified in the aspects of logics, validity 
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„}rodymai yra tinkami juos patikrinant 
logiskumo, pagrjstumo ir objektyvumo po- 
ziuriais", be to, ataskaitoje „akcentuojami 
kolegijij. pazangos, integracijos parametrai". 
Kiti respondentai pabreze, kad jsivertinimo 
ataskaitos analize nepakankamai objektyvi, 
nes ji nera pagrjsta vien tik kiekybiniais 
parametrais: „isorinis vertinimas buti^ skai- 
dresnis, jeigu vertinime dominuoti^ kieky- 
biniai parametrai". Respondentai taip pat 
akcentavo, kad per mazai demesio skiriama 
sisteminiam poziuriui j kolegijos veiklos 
kokybes uztikrinim^: “butif zymiai tikslin- 
giau, jei kolegijij. isoriniam instituciniam 
vertinimui (jvertinimui - aut.) skirtose sa- 
vianalizese (}sivertinimo ataskaitose - aut.) 
aukstosios mokyklos veikla ir jos pasiekimai 
butij analizuojami konkrecios aukstosios 
mokyklos jdiegtos vidines kokybes uztikrini- 
mo sistemos kontekste”. 

Problemas, kylancias siame jvertinimo 
etape, siulyta spr^sti tokiu budu; 

• isanalizuoti ir jvertinti kolegijq pateik- 
tas jsivertinimo ataskaitas, vadovauj antis kie- 
kybiniais parametrais, kurie parodo realms 
ir konkrecius kolegijos veiklos pasiekimus 
(rezultatus); 

• jvertinti kolegijos veikl^ pagal jsiver- 
tinimo ataskaitoje pateikt^ informacij^, di- 
desnj demesj skirti institucijos vidines ko- 
kybes uztikrinimo sistemos veiksmingumui 
jvertinti, taip pat isryskinti, ar patikimai vei- 
kia kolegijos veiklos privalumij ir trukump 
nustatymo sistema, ar priimami adekvatus 
nutarimai dd veiklos gerinimo, kaip nusta- 
tomas socialinip dalininkp (studentp, desty- 
toji|, administradjos darbuotojp ir institud- 
jp, su kuriomis bendradarbiaujama, atstovcj) 
pasitenkinimas kolegijos veiklos kokybe, 
kai priimti sprendimai kokybei gerinti jau 
jgyvendinti. 

3. Isorinio vertinimo vizitas. Respon- 
dentai pabreze, kad sio etapo esme - isori- 
niq vertintojLj susitikimai su kolegijos ben- 
druomene. Jie taip pat jvardijo dokumenti^. 


and impartiality”, moreover, the report “focuses 
on the parameters of the college progress and in- 
tegration processes”. Other respondents have 
emphasised the analysis of the self-evaluation 
report is insuffidently unbiased as it is not 
groimded only on quantitative parameters: “ex- 
ternal assessment would be more transparent if 
quantitative parameters would dominate in this 
assessment”. The respondents have also em- 
phasised that too vague attention is paid for a 
systematic approach to quality assurance of the 
colleges work: “in the self analysis (self-evalua- 
tion reports - auth.) intended for college external 
institutional assessment (evaluation - auth.) it 
would be much more appropriate to analyse the 
work and achievements of the higher school in the 
context of the implemented internal quality as- 
surance system in the particular higher school”. 

It has been suggested that the problems 
met in this evaluation stage could be solved 
like this: 

• to analyse and evaluate the self-evalua- 
tion reports of colleges regarding quantitative 
parameters that reveal real and concrete achi- 
evements (results) of the college’s work; 

• to evaluate the college’s work following 
the data in the self-evaluation report and pay 
more attention to the evaluation of the effec- 
tiveness of the internal quality assurance sys- 
tem, to highlight whether the system is relia- 
ble to identify the strengths and weaknesses 
of the college, whether decisions for the work 
improvement are relevant, how the college 
measures the satisfaction of the stakeholders 
in its quality (students, lecturers, administra- 
tive staff, representatives of the institutions it 
cooperates with) after the decisions for quali- 
ty improvement have been put into practice. 

3. An external assessment visit. The re- 
spondents have emphasised the meetings of 
external evaluators with the college commu- 
nity as the essence of this stage. They have also 
mentioned the importance of the analysis of 
the documents presented for the evaluators 
when they come to the college. The research 
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kurie pateikiami vertintojams kolegijoje, 
analizes svarb^. Apklaustieji susitikimp su 
jvairiomis kolegijos bendruomenes gru- 
pemis jvairov^ vertino teigiamai, taciau jie 
isryskino problemas, kylancias dd grupip 
sudeties: „didziausias trukumas yra tas, kad 
susitikimuose su vertintojais dalyvauja tik 
pacios kolegijos is anksto atrinkti ir, galbut, 
specialiai tarn paruosti asmenys. Tokiam vi- 
zitui truksta objektyvumo”. Respondentai 
pripazino, kad vertintojams kolegijoje pa- 
teikti dokumentai suteikia daug papildo- 
mos informadjos apie institudjos veikl^, 
tadau nejmanoma atlikti gilesnes jq anali- 
zes: „ekspertams yra labai sunku per gana 
trumpq vizito laikotarpj ne tik surinkti visus 
galimus jrodymus pokalbiq su kolegijq ben- 
druomeniq atstovais metu, bet kartu anali- 
zuoti papildomai pateiktus dokumentus, ku- 
riq kartais buna gana daug“. 

Respondentai pateike siulymp, kaip 
spr^sti vertinimo vizito metu kylandas 
problemas: 

• is oriniq vertintoj p gr up es vizito darb o - 
tvarke turetp buti kuo anksdau ir kuo placiau 
paskelbiama kolegijos bendruomenei - jde- 
dama j kolegijos internetinj tinklalapj, iska- 
binama visq kolegijos padalinip skelbimp 
lentose, kad informadja apie vertintojp darb^ 
kolegijoje pasiektp visus norincius; 

• vizito darbotvark^ tikslinga papildyti 
1-2 val. atviru posedziu, kuriame galetp da- 
lyvauti visi kolegijos bendruomenes nariai, 
pageidaujantys vertintojams issakyti savo 
nuomon^, patirtj ir nuostatas apie kolegijos 
veikl^ ir jos perspektyvas; 

• kolegijos administracija neturdp at- 
rinkti studentp, dalyvausiandp susitikime su 
vertintojais; jie turdp ateiti savo iniciatyva, 
suderin^ savo dalyvavim^ su kolegijos stu- 
dentp atstovybe; 

• papildomus kolegijos dokumentus 
tikslinga pateikti vertintojams ne pirmqj^ vi- 
zito dien^, kaip buvo daroma iki siol, bet bent 
pries 5 dienas iki vizito. 


partidpants have positively assessed the variety 
of the college community groups participating 
in the meetings, however they have showed 
some problems related to the composition of 
those groups: “the most considerable shortcom- 
ing is the participation of individuals who have 
been selected for the meetings with the experts 
by the college itself and, maybe, they have been 
specially prepared for the meetings. Such a visit 
lacks impartiality”. The respondents have rec- 
ognised that much supplementary data on the 
institutions work could be found in the docu- 
ments presented for the evaluators when they 
come to the college, however it is impossible 
to make their deeper analysis: “experts appear 
in a complicated situation when during a short 
visit, communicating with the representatives of 
colleges, they have to collect all the possible evi- 
dence, and at the same time, analyse plenty of 
the supplementary documents”. 

The respondents have suggested how the 
problems met in the assessment visit could be 
solved: 

• the timetable of the external assessment 
visit should be announced to the community 
of the college as early and widely as possible - 
it should be posted on the colleges web page 
and boards of all the colleges departments so 
that information could reach aU those interes- 
ted in the work of assessors during their visit 
in the institution; 

• an open meeting of 1 or 2 hours could 
be added to the timetable of the visit in order 
to make a possibility for all the members of the 
college community to participate and express 
their position, experience or attitude towards 
the college’s work and its perspectives; 

• students should not be selected by the 
college administration to participate in the 
meeting with assessors; they should come 
on their own initiative after they have agreed 
with the student representatives on their par- 
ticipation in the meeting; 

• the supplementary documents on the 
college’s work should be presented for the 
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4. Isorinio jvertinimo ataskaitos pa- 
rengimas ir paskelbimas. Respondentai 
aptare sio etapo dedam^sias: ataskaitos 
analitines, rekomendacines ir jvertinamo- 
sios daliq parengim^ bei dokumento teksto 
vies^ pristatym^. Jie nurode, kad rengiant 
ataskait^ problem^ kyla tada, kai jvertin- 
tojai nesilaiko nuoseklumo: „daznai eks- 
pertinis vertinimas (jvertinimas - aut.) yra 
neskaidrus, nes ekspertai pradeda darbq nuo 
jvertinamojo sprendimo formulavimo ir tik 
paskui yra rengiama analitine dalis ir ren- 
kami jrodymai kolegijos veiklos stipriosioms 
ir tobulintinoms pusems pagrjsti". Kai kurip 
respondentij nuomone, ataskaitoje neture- 
tij buti pateikiamas galutinis jvertinamasis 
sprendimas: „labai aiskiai turi buti atskirtas 
vertinimas nuo sprendimo priemimo. Eks- 
pertif grupe, baigusi vertinimq, turi pateikti 
suinteresuotoms salims tik veiklos sriciq jver- 
tinimus ir argumentus bei rekomendacijas 
kokybei gerinti"; „jvertinamuosius sprendi- 
mus turi formuluoti kiti asmenys, t. y. arba 
patarianciqjq institucijq, arba svietimo mi- 
nisterijos atstovai". Apklaustieji akcentavo, 
kad viesai skelbiant jvertinimo ataskait^ 
pateikiamas per daug detains tekstas: „nera 
tikslinga visq vertinimo (jvertinimo - aut.) 
ataskaitos tekstq viesai skelbti visai kolegijos 
bendruomenei, ypac kai sis tekstas yra tik 
ataskaitos pro] ektas ir pasibaigus vizitui gali 
buti koreguojamas". 

Siame jvertinimo etape kylancias pro- 
blemas respondentai patare spr^sti tokiu 
budu: 

• jvertinimo ataskait^ pradeti analiti- 
ne ir baigti jvertinam^ja dalimi - is pra- 
dzip pateikti argumentus, pagrindziancius 
kolegijos privalumus ir trukumus pagal 
atskiras veiklos sritis, ir tik juos jvardijus 
nuspr^sti, kokia visos institucijos veiklos 
kokybe; 

• isorinii^ jvertintoji^ atsakomyb^ tiks- 
linga apriboti kolegijos veiklos sriciq jver- 
tinimu ir vertinimo argumenti^ pateikimu. 


assessors not on the first day of the visit, as it has 
been practiced before, but at least 5 days to the 
visit. 

4. The preparation and announcement 
of the external evaluation report. The respon- 
dents have discussed the constituents of this 
stage: the preparation of analytical, recommen- 
datory and evaluative parts of the report as well 
as the publishing of the document. They have 
showed that problems are met in cases when 
evaluators do not keep to the sequence of the 
preparation of the report: “the assessment (eval- 
uation - auth.) by experts is often not transpar- 
ent when they start their work with an evaluative 
decision, and only after that prepare an analytical 
part and collect evidences to prove strengths and 
weaknesses of the college work”. Due to some re- 
spondents, the report should not present the fi- 
nal evaluative decision: “assessment and decision 
making should be separated very clearly. When 
the expert group complete their work, they should 
present to the stakeholders only the evaluation 
of the areas of the colleges work, their evidence 
and recommendations for quality improvement”; 
“evaluative decisions should be made by others, 
i.e. representatives of advisory bodies or the min- 
istry of education”. The research participants 
have emphasised that a too detailed text is being 
presented when the evaluation report is being 
published: “it is not necessary to publish the full 
text of the assessment (evaluation - auth.) report 
to the entire college community, in particular, 
when this text is only a draft of the report and 
can be revised when the visit is over”. 

The respondents have suggested that the 
problems met in this evaluation stage could be 
solved by the following actions: 

• the evaluation report could be started 
with an analytical part and completed with an 
evaluative one, i.e. at first, evidence could be 
presented to prove the strengths and weaknes- 
ses of the college with regard to different areas 
of its work, and when they have been identi- 
fied, it is time to decide on the quality of the 
work of the entire institution; 
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Apibendrinam^jj jvertinam^jj sprendim^ 
del kolegijos veiklos kokybes ir kolegijos 
akreditadjos turetp formuluoti ne isori- 
niai jvertintojai, bet kokybes uztikrinimo 
agenturos patariandosios institudjos arba 
svietimo ministerijos atstovai. Tai jie gale- 
tp atlikti pasitelkdami isorinip jvertintojp 
parengtas ataskaitas ir kitus nacionalinius 
bei europinius aukstojo mokslo sistemos 
parametrus; 

• visai kolegijos bendruomenei skelbti 
sutrumpint^ isorinio jvertinimo ataskaitos 
projekto tekst^, o kolegijos akademinei ta- 
rybai bei administradjai - issamp. Su siais 
kolegijos atstovais suderinti ir aptarti reko- 
mendacijp tobulinti veiklos kokyb^ s^sajas 
su kolegijos strateginiais prioritetais. 

5. Procedures pabaigus isorinj jver- 
tinim^. Respondentai isskyre dviejq tipp 
proceduras: kolegijp isorinio jvertinimo 
proceso jvertinim^, apimantj jame dalyva- 
vusius asmenis (dalyviq grjztamasis rysys) 
ir kitas proceduras, leidziandas panaudoti 
isorinio jvertinimo metu gautus rezultatus 
ne vien atskiros kolegijos, bet visp kolegi- 
jp mastu. Apklaustieji pabreze pirmosios 
proceduros svarb^ ir neiskele jokip su ja 
susijusip problem^: „kolegijif veiklos iso- 
rinis institucinis vertinimas (jvertinimas - 
aut.) apima daug procesi^, kuriuos pabaigus 
labai svarbu surinkti visi} dalyvii} atsiliepi- 
mus ir siulymus procesij tobulinimui"; 
„gr}ztamasis rysys, gautas apklausus tick 
vertintojus, tiek vertinamuosius, yra labai 
svarbi medziaga vertinimo agenturai, to- 
bulinant vertinimo procesus ateityje". Kitas 
proceduras, taikomas pabaigus isorinj jver- 
tinim^, respondentai pripazino keliando- 
mis problem^: „pabaigus isorinj vertinimq 
(jvertinimq - aut.), kolegijos yra paliekamos 
visiskai savarankiskai jgyvendinti eksper- 
tq suformuluotas rekomendaeijas, kurios 
kartais buna suprantamos dviprasmiskai"; 
„pabaigus isorinio vertinimo (jvertinimo - 
aut.) ciklq, butina atlikti sistemin^ gautq 


• it is advisable to limit the responsibility of 
external evaluators to the evaluation of colleges 
work areas and the presentation of assessment 
evidence. The summative evaluative decision on 
the quality of the colleges work and the colleges 
accreditation should be made not by external 
evaluators, but the advisory institutions of the 
quality assurance agency or representatives of 
the ministry of education. They could perform 
this with the help of external evaluation reports, 
national and European parameters of higher 
education system; 

• to announce a shorter text of the external 
evaluation report to the entire college commu- 
nity, and present the comprehensive one to the 
academic board of the college and its administra- 
tion. To agree and discuss the links between the 
recommendations for the quality improvement 
and the strategic priorities of the college with the 
mentioned representatives of the college. 

5. The follow-up procediu^es of external 
evaluation. The respondents have distinguished 
two types of those procedures: the evaluation 
of the external evaluation of the college in the 
attitude of those who have participated in the 
process (participants’ feedback) and other pro- 
cedures enabling to use the results of external 
evaluation in a particular institution or at the 
college sector level. The research participants 
have emphasised the importance of the first pro- 
cedure, and they have not mentioned any related 
problems: “the external institutional assessment 
(evaluation - auth.) of the colleges work includes 
many processes, and when they are completed, it 
is essential to collect the reviews and suggestions of 
all the participants for the process improvement”; 
“the feedback received by surveying the assessors 
and individuals assessed is a very important ma- 
terial for the assessment agency to improve the 
assessment process in the future”. Other follow- 
up procedures of external evaluation have been 
recognised as problematic ones by the respon- 
dents: “when external assessment (evaluation - 
auth.) is completed, colleges are left alone to put 
experts’ recommendations into practice, however. 
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rezultatij analiz^, siekiant nustatyti visam 
kolegijij. sektoriui budingas problemas ir j as 
pristatyti tick visuomenei, tiek svietimo sis- 
temos optimizavimo sprendimus priiman- 
cioms institucijoms". 

Problemas, kylancias naudojant isori- 
nio jvertinimo rezultatus, respondentai siule 
spr^sti tokiu budu: 

• teikti kolegijoms issamius isoriniq 
jvertintojp suformuluodj rekomendadjq 
isaiskinimus; 

• stebeti, kaip kolegijos jgyvendina iso- 
rinip jvertintojp suformuluotas veiklos koky- 
bes tobulinimo rekomendadjas; 

• pladau panaudoti ankstesnius kole- 
gijos isorinip vertinimp rezultatus (studijp 
programp ir institucijos) velesniems kolegijos 
isoriniams vertinimams; 

• pasibaigus jvertinimo dklui, atlikti vi- 
sapusj kolegijp jvertinim^, isryskinant ben- 
dr^sias jp funkcionavimo ypatybes ir jp ple- 
tros problemas. 


ISVADOS 

1. Kolegijos isorinis jvertinimas - tai kolegijos 
bendruomenei nepriklausandp asmenp atlie- 
kamas vertinimas ir, remiantis jo rezultatais, 
nutarimo priemimas apie institudjoje sudary- 
tp studijp s^lygp tinkamum^ parengti speda- 
listus, orientuotus j praktin^, mokslo ir tech- 
nologijp naujovemis pagrjst^ profesin^ veikl^. 

2. Kolegijp isorinj jvertinim^ sudaro pen- 
ki etapai: pasirengimas isoriniam jvertinimui, 
kolegijos parengtos jsivertinimo ataskaitos 
tyrimas, isorinio vertinimo vizitas, isorinio 
jvertinimo ataskaitos parengimas ir paskelbi- 
mas, proceduros pabaigus isorinj jvertinim^. 

3. Kolegijp isorinio jvertinimo metu ky- 
lancias problemas siuloma spr^sti atitinka- 
mais budais: 


sometimes they are ambiguously understood”; 
“when the cycle of external assessment (evalua- 
tion - auth.) is completed, it is imperative to carry 
a systematic analysis of the received results in or- 
der to identify the problems typical for the entire 
college sector and present them both to the society 
and institutions making decisions on the optimi- 
sation of the education system”. 

The respondents have suggested that the 
problems met in the use of the results of exter- 
nal evaluation could be solved as follows: 

• to provide comprehensive explications 
of external evaluators’ recommendations for 
colleges; 

• to monitor how colleges put into prac- 
tice quality improvement recommendations 
proposed by external evaluators; 

• to use more widely the results of the 
former external study programme and insti- 
tutional assessment of the college for its sub- 
sequent external assessment; 

• to perform a comprehensive college eva- 
luation after the completion of the evaluation 
cycle and identify general peculiarities of their 
work and problems of their development. 

CONCLUSIONS 

1. The external evaluation of colleges is the as- 
sessment by individuals outside the college’s 
community and, following the results of this as- 
sessment, their judgement on the quality of the 
college’s work, with regard to the conformance 
of the opportunities provided in the institution 
to develop professionals for practical work ap- 
plying science and technological innovations. 

2. The external evaluation of colleges is 
structured of five stages: the preparation for 
the external evaluation of higher schools, the 
study of the self-evaluation report prepared by 
the higher school, an external assessment visit, 
the preparation and announcement of the ex- 
ternal evaluation report, the follow-up proce- 
dures of external evaluation. 
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3.1. Sklandq pasirengim^ isoriniam jver- 
tinimui uztikrintp aiskus kolegijp isorinio 
jvertinimo tikslai, tiksliai parengta kolegijos 
jsivertinimo ataskaita ir kompetentingi isori- 
niai jvertintojai. 

3.2. Kolegijos jsivertinimo ataskaitos 
analize ir jos jvertinimas taptp objektyvesni 
siame etape vadovauj antis kiekybiniais para- 
metrais ir skiriant didesnj demesj kolegijos 
vidines kokybes uztikrinimo sistemos veiks- 
mingumui jvertinti. 

3.3. Vertinimo vizitp skaidrum^ padidin- 
tp daugiau susitikimuose su vertintojais savo 
iniciatyva dalyvaujancip asmenp, o vizitp 
veiksmingum^ - galimybe isanalizuoti papil- 
domus kolegijos dokumentus iki vertintojp 
vizitp. 

3.4. Rengiant jvertinimo ataskaitas bu- 
tina laikytis nuoseklumo: pradeti analitine 
ir baigti jvertinam^ja dalimi - is pradzip 
pateikti argumentus, pagrindziancius kole- 
gijos privalumus ir trukumus pagal atskiras 
veiklos sritis ir tik juos jvardijus nuspr^sti, 
kokia visos institudjos veiklos kokybe. Vie- 
sai pristatant jvertinimo ataskaitos projek- 
t^, rekomenduojama skelbti sutrumpint^ jo 
variant^. 

3.5. Pasibaigus isoriniam jvertinimui 
kolegijoms tikslinga pateikti issamius isori- 
niq jvertintojp suformuluotp rekomendadjp 
isaiskinimus ir stebeti, kaip rekomendacijos 
vykdomos. 

3.6. Remiantis jvertinimo rezultatais re- 
komenduojama atlikti visq neuniversitetinip 
aukstpjp mokyklq apibendrint^ jvertinim^, 
atskleidziantj bendras jp funkcionavimo ypa- 
tybes ir jp pldros problemas. 


3. The problems met in the external evalu- 
ation of colleges could be solved by the follow- 
ing means: 

3.1. Explicit goals of the external evalua- 
tion of colleges, precisely prepared self-evalu- 
ation reports by colleges and competent exter- 
nal experts would assure a fluent preparation 
for external evaluation. 

3.2. The analysis and evaluation of the col- 
lege’s self-evaluation report would become more 
impartial following quantitative parameters and 
focusing on the evaluation of the effectiveness of 
the college’s internal quality assurance system. 

3.3. Assessment visits would become more 
transparent due to a larger number of individ- 
uals participating on their own initiative in the 
meetings with assessors, and visits would turn 
more effective with the possibility for assessors 
to analyse the supplementary documents of 
the college before the beginning of the visit. 

3.4. It is indispensable to keep to the se- 
quence of the preparation of evaluation reports: 
to start with an analytical part and complete 
with an evaluative one, i.e. at hrst, to present 
evidence proving the strengths and weaknesses 
of the college with regard to different areas of 
its work, and when they have been identihed, to 
decide on the quality of the work of the entire in- 
stitution. Publishing the draft of the evaluation 
report, its shorter version could be presented. 

3.5. When the external evaluation has heen 
completed, it is advisable to provide compre- 
hensive explications of external evaluators’ rec- 
ommendations for colleges and monitor how 
these recommendations are put into practice. 

3.6. On the basis of the evaluation results, 
it is recommended to perform summative 
evaluation of the non-university higher educa- 
tion sector, and identify general peculiarities 
of its work and problems of its development. 
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